Method and system for re-projection for multiple-view displays

ABSTRACT

Systems and methods are provided that allow for the rapid creation of multiple novel views for applications. These multiple views may allow for not only stereo views but also for different viewpoints of a stereographic scene to be presented, or for a time progression of the stereo scene to be presented, where a viewpoint is altered with respect to time. The systems and methods may be employed to create the content for auto-stereographic displays or multiple view systems that use a plurality of novel views to display stereo media. Such displays or multiple view systems may include those employing parallax barriers or lenticular lenses.

BACKGROUND

Movies presented in 3D are enjoying tremendous popularity. One way ofachieving three-dimensional images is by way of stereography. Instereography two images are captured and presented to a user, one from aleft camera and for the left eye of a viewer, and one from a rightcamera and for the right eye of a viewer. Stereography is one of theoldest ways of producing a 3D image for a viewer.

Recent advances in 3D video include the attempted use of lenticulardisplays or parallax barriers to achieve different views. In suchattempts, however, different video feeds are provided to differentcomponents of the display. If as is typical eight to sixteen views areprovided, eight to sixteen different sets of sequential video imagesmust be provided.

Thus in these systems as well as in stereography significant costs inurein terms of processing power, time, and storage. In fact, with currenttechnology and for certain particularly complicated shots, hundreds ofhours may be required to render a single frame, and multiplying thistime for a plurality of alternate viewpoints is prohibitive.

In stereography, re-projection techniques have been developed to reusepixel color values, rendered for one eye, for the other eye in anotherview, by mapping the same to an appropriate point for the other view asdetermined by the scene geometry including the desired intraoculardistance, and thus creating a 3D image. In one such technique, from adepth map a mesh is created and the mesh is rendered in a renderingpackage. The depth map is polygonalized from the point of view of thecamera that rendered the depth map, and UV coordinates are assigned tothe mesh. The mesh is then textured, and subsequently the mesh can thenbe rendered from any other point of view or viewing angle, e.g., for adifferent view or eye for a stereographic image.

However, such current re-projection techniques are slow and can lead toundesirable results.

This Background is provided to introduce a brief context for the Summaryand Detailed Description that follow. This Background is not intended tobe an aid in determining the scope of the claimed subject matter nor beviewed as limiting the claimed subject matter to implementations thatsolve any or all of the disadvantages or problems presented above.

SUMMARY

Systems and methods according to principles described here allow for therapid creation of multiple novel views for applications. These multipleviews may allow for not only stereo views but also for differentviewpoints of a stereographic scene to be presented, or for a timeprogression of the stereo scene to be presented, where a viewpoint isaltered with respect to time. The systems and methods may be employed tocreate the content for auto-stereographic displays or multiple viewsystems that use a plurality of novel views to display stereo media.Such displays or multiple view systems may include those employingparallax barriers or lenticular lenses.

In one aspect, the invention is directed towards a system for creating amultiple-view display, including: an input module for receiving acomputer-generated image of a scene, the computer-generated imageincluding at least depth information about the scene; a re-projectionmodule for creating a plurality of alternate images corresponding todifferent views of the scene, where the image and alternate images aresuch that a viewer observing the image and one of the plurality, or twoof the plurality, perceives a view of the scene as a three-dimensionalscene; and a storage module for storing the image and the plurality ofimages.

Implementations of the invention may include one or more of thefollowing. The image may be from a video file, from a game engine, orthe like. The re-projection module may select a location for thealternate image, create a disparity map indicating differences betweenthe image and the alternate image, create a distortion map indicatingpixel transforms based on the disparity map, and create the alternateimage by applying the distortion map to the pixels of the image. There-projection module may further: apply a custom adaptive sharpeningfilter to one or more objects in the alternate image, the customadaptive sharpening filter configured to increase a prevalence ofhigh-frequency components and decrease a prevalence of low-frequencycomponents; or for one or more objects in the image, the one or moreobjects surrounded by a background or clipping plane, temporarily extendthe object's size by 1-10 pixels whereby when re-projection occurs,pixels in the object are mapped properly during re-projection and notextended back to the background or clipping plane.

In another aspect, the invention is directed towards a method forcreating a multiple-view display, including: receiving acomputer-generated image of a scene, the computer-generated image havinginformation including at least depth information; using a step ofre-projection, generating a plurality of alternate images, the alternateimages corresponding to different views of the scene, where the imageand alternate images are such that a viewer observing the image and oneof the plurality, or two of the plurality, perceives a view of the sceneas a three-dimensional scene; and storing the image and the alternateimages corresponding to the different views of the scene.

Implementations of the invention may include one or more of thefollowing. The plurality may number from two to sixteen. For example,the plurality may include eight images, four on one side of the imageand four on an opposite side of the image. Each set of four may beequi-angularly spaced from the image. The step of re-projection mayinclude calculating a view of the scene from a different angle. Inaddition, the step of re-projection may include: selecting a locationfor the alternate image; creating a disparity map indicating differencesbetween the image and the alternate image; creating a distortion mapindicating pixel transforms based on the disparity map; and creating thealternate image by applying the distortion map to the pixels of theimage. The step of re-projection may further include performing one orboth of the following steps: applying a custom adaptive sharpeningfilter to one or more objects in the alternate image, the customadaptive sharpening filter configured to increase a prevalence ofhigh-frequency components and decrease a prevalence of low-frequencycomponents; or for one or more objects in the image, the one or moreobjects surrounded by a background or clipping plane, temporarilyextending the object's size by 1-10 pixels whereby when re-projectionoccurs, pixels in the object are mapped properly during re-projectionand not extended back to the background or clipping plane.

In yet another aspect, the invention is directed towards multiple-viewdisplay, including: an input module for receiving a data file, the datafile including multiple sets of images corresponding to various views ofa scene, each set corresponding to a geographic area on a displayscreen, each member of each set corresponding to a different view of thescene as displayed at the geographic area, at least one member of eachset developed by a step of re-projection of an original image, theoriginal image including at least depth information about the scene; adisplay module to display each set at its corresponding geographic area,and to display each member of the set within the area; and a directionalviewing system disposed adjacent the display module, the directionalviewing system configured to direct a view of each member substantiallyat a given angle relative to the plane of the geographic area.

Implementations of the invention may include one or more of thefollowing. The directional viewing system may be a lenticular display ora parallax barrier. The given angle may be different for each member ofa set. Corresponding members of sets may direct views at a common anglerelative to the plane of the geographic area. The directional viewingsystem may be configured to direct views at between two and sixteendifferent angles. The geographic area may be a line of display. Thegeographic area may be in the shape of a rectangle. Each member of theset may be created by re-projection by selecting a location for themember of the set, creating a disparity map indicating differencesbetween the original image and an image corresponding to the member ofthe set at the location, creating a distortion map indicating pixeltransforms based on the disparity map, and creating the imagecorresponding to the member of the set at the location by applying thedistortion map to the pixels of the original image. The imagecorresponding to the member of the set may be further created by:applying a custom adaptive sharpening filter to one or more objects inthe image corresponding to the member of the set, the custom adaptivesharpening filter configured to increase a prevalence of high-frequencycomponents and decrease a prevalence of low-frequency components; or forone or more objects in the original image, the one or more objectssurrounded by a background or clipping plane, temporarily extending theobject's size by 1-10 pixels whereby when re-projection occurs, pixelsin the object are mapped properly during re-projection and not extendedback to the background or clipping plane.

In a further aspect, the invention is directed towards a data file, thedata file including multiple sets of images corresponding to variousviews of a scene, each set corresponding to a geographic area on adisplay screen, each member of each set corresponding to a differentview of the scene as displayed at the geographic area, at least onemember of each set developed by a step of re-projection of an originalimage, the original image including at least depth information about thescene.

Implementations of the invention may include one or more of thefollowing. The geographic area is a vertical line of display and may bein the shape of a rectangle. Each member of the set may be created byre-projection by selecting a location for the member of the set,creating a disparity map indicating differences between the originalimage and an image corresponding to the member of the set at thelocation, creating a distortion map indicating pixel transforms based onthe disparity map, and creating the image corresponding to the member ofthe set at the location by applying the distortion map to the pixels ofthe original image. The image corresponding to the member of the set maybe further created by: applying a custom adaptive sharpening filter toone or more objects in the image corresponding to the member of the set,the custom adaptive sharpening filter configured to increase aprevalence of high-frequency components and decrease a prevalence oflow-frequency components; or for one or more objects in the originalimage, the one or more objects surrounded by a background or clippingplane, temporarily extending the object's size by 1-10 pixels wherebywhen re-projection occurs, pixels in the object are mapped properlyduring re-projection and not extended back to the background or clippingplane.

Advantages of certain implementations of the invention may include oneor more of the following. Certain systems and methods of creating anovel view from an existing image can be performed without creating orrendering geometry and therefore are faster than previous techniques.The results of such systems may be employed to provide image data formultiple view displays, including lenticular displays and thoseemploying parallax barriers. Other advantages will be apparent to one ofordinary skill in the art, given the description that follows, includingthe figures and claims.

This Summary is provided to introduce a selection of concepts in asimplified form that are further described below in the DetailedDescription. This Summary is not intended to identify key features oressential features of the claimed subject matter, nor is it intended tobe used as an aid in determining the scope of the claimed subjectmatter.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 illustrates a set of virtual stereo cameras imaging an object, aswell as a view from each of the respective cameras.

FIG. 2 is a flowchart of a method of re-projection according to theprinciples disclosed here.

FIG. 3(A) illustrates a schematic depiction of a multiple view display,and FIGS. 3(B) and 3(C) illustrate side views of the display of FIG.3(A), illustrating different ways of enabling multiple views.

FIG. 4 illustrates how a column of the display of FIG. 3(A) isconstituted of images for multiple displays, in this case, for fourdifferent views.

FIG. 5 illustrates a flowchart of a method according to principlesdisclosed here.

FIG. 6 illustrates the structure of the data file being employed toprovide input to a multiple view system.

FIG. 7 illustrates a modular computing environment of the systemaccording to principles disclosed here.

FIG. 8 illustrates another computing environment of the system accordingto principles disclosed here in which a raw video file or video feedfrom a camera may be input to the system and caused to provide amultiple view output.

FIG. 9 illustrates a schematic depiction of a multiple view display, inwhich multiple views are evident in two viewing dimensions.

FIG. 10 is a schematic depiction of the computing environment in whichthe systems and methods according to principles disclosed here may beimplemented.

Like reference numerals refer to like elements throughout. Elements arenot drawn to scale unless otherwise noted.

DETAILED DESCRIPTION

This specification incorporates by reference herein U.S. patentapplication Ser. No. 13/649,788, filed Oct. 11, 2012, entitled “SYSTEMAND METHOD FOR REDUCING ARTIFACTS CAUSED BY VIEW DEPENDENT LIGHTINGCOMPONENTS”, owned by the assignee of the present application.

Prior to the description of re-projection in the creation of data formultiple view displays, an exemplary method of re-projection isdiscussed in simplified fashion here.

FIG. 1 illustrates a schematic depiction of an exemplary system 11 for afast re-projection technique. In FIG. 1, a first stereo camera 13 imagesan object 19, and an exemplary point 25 on the object is illustratedwith a ray 21 extending between the point 25 and the camera 13. Theintent of re-projection is to obtain a pixel color value for the point25 as seen by a second stereo camera 15 without having to perform alengthy rendering process. In essence, re-projection “re-uses” the pixelvalue as calculated for the left eye for the right eye. In the scenarioof FIG. 1, as long as the location of the camera for the new view isknown, and so long as the distance of the object 19 from a viewing plane(also termed the “camera plane”) of one or both cameras is known, thelocation of the point 25 for a viewing plane of the second camera 15,and in particular its pixel color value, can be calculated. A rayindicating point 25 on the viewing plane of the second camera is shownby the ray 23.

Knowing depths allows the creation of a depth map. A depth map is a mapof a depth value for every pixel (x,y), and the depth is the distancefrom the camera plane to the point being imaged by the pixel, e.g., acharacter, an object, a clipping plane, “infinity” (which is generallyindicated as an arbitrary high number for depth), or the like. The depthmap may be a rendered image that is calculated at the same time as thecolor image, where depth is an arbitrary output variable or AOV. Thedepth may be indicated in whatever units the rendered scene is in, e.g.,centimeters.

Referring back to FIG. 1, also illustrated our views or viewing planes29 and 31 for the first and second cameras, respectively. Theseillustrate where the point 25 from the left eye is transformed in spaceif applied to the right eye. In views 29 and 31, the point 25 atlocation (x,y) is transformed such that the same point appears in thesecond camera at (x+Δx,y+Δy), indicated by point 25′. In other words,the system has calculated a Ax and Ay for the pixel. If such iscalculated for each pixel in the image, a disparity map is created,which indicates how many pixels are required for a translation,generally in the X and Y directions, to obtain a pixel color value froma point in a first camera, i.e., a point on a first viewing plane, toobtain where the color value should be placed in the second viewingplane. Every pixel from an original camera view can be mapped to a pixelin a new camera view. For example, a disparity map may indicate that ahorizontal translation of 1.8 pixels is required to obtain views for asecond camera relative to a first camera. In other examples, some pixelsmay move entirely off the screen and thus be unseen by the secondcamera, particularly where objects are very close to the first camera.

The calculated disparity map may then be employed to create a distortionmap. The distortion map indicates information about what pixelinformation may be accessed in the original or first view to obtain acolor value for a point in the new or second view. The distortion mapthen acts as a guide for what pixel in the first view should be accessedto obtain a color value for pixel in the second view. So if the pixelcolor value is translated by 100 pixels, and the original was at (0,0),the new would be (100,0). The distortion map, created in the space ofthe second view, is used as a look up from the second view to the firstview.

In essence re-projection desirably “re-uses” pixel color values from thefirst camera view, negating the need to perform a rendering step toobtain values for the second camera view. Such reuse results insignificant computational savings.

Re-projection requires depth information (as well as an (x,y) location)for each pixel to be re-projected. If an image from a live-action shotis employed, in many cases such depth information will be lacking.Cameras exist, however, which to a certain extent can obtain depthinformation from the objects imaged. Moreover, it is envisioned, andwithin the scope of the principles disclosed here, to employ live-actioncameras that are even more enhanced and can obtain depth information formost if not all objects in a shot e.g., employing range imaging. Thisdepth information for each pixel could be conveniently employed incertain methods disclosed here to create a second image for stereophotography.

FIG. 2 is a flowchart 39 of a method according to these principles. In afirst step, a first image is received, the first image including a setof pixels, each having color data, depth data, and a location in theviewing plane (step 41).

In one optional implementation, a step may then be performed to extendthe edges around the perimeter of certain objects (step 55), e.g.,objects surrounded by backgrounds where the backgrounds are far awaysuch as at “infinity” or a clipping plane. The reason is that adeleterious artifact of re-projection of such objects is thatoccasionally edge pixels may be stretched back to the background. Byextending the object a few pixels in all directions, beyond its priorperimeter in the calculation, such artifacts are reduced because pixelsare carried around the object as the view is changed, not allowing anedge to be pulled back to the clipping plane. In other words, theincoming depth data is ‘modified’ to extend the edges of the object, tohelp prevent stretching. A suitable number of pixels may be, e.g., 1 to10 pixels distance away from the original edge of the object.

A next step is to create a disparity map indicating pixel differencesbetween a first camera view and a second camera view (step 43). A nextstep is to create a distortion map indicating pixel transforms based onthe disparity map (step 45). Essentially, the distortion map provides arecipe for creating pixel color values in the new or second view fromthose in the original. Finally, a second image may be created byapplying the distortion map to the pixels of the first image (step 48).

Various steps may also be performed before, during, or after there-projection. One exemplary step is the application of a customadaptive sharpening filter (step 53). Such a custom adaptive sharpeningfilter can cause an emphasis of high-frequency components and a decreaseof prevalence of low-frequency components. In more detail, whenperforming the re-projection, i.e., looking up new pixel values fromoriginal ones, on occasion an interpolation will have to be performedbetween two original pixels. If the system was designed to simplyaverage the color values, a softening of the result would occur, and thesame may in some cases be undesirable for particular effect. A lookupmay be configured to use a kernel that attempts to preservehigh-frequency detail.

Put another way, re-projection causes a mapping, and such mappinginherently involves resampling. Resampling usually causes a level ofaliasing effects, and aliasing effects are generally pronounced athigh-frequency areas. Thus, such a filter, which includes negativelobes, will reduce such aliasing effects and results in a higher-qualityimage.

FIG. 3(A) illustrates a view of an exemplary prior art lenticular orparallax barrier display 10. In the display 10, a set of views areprovided within each column of the display, the columns being enumerated12 a, 12 b, 12 c, and so on. For a standard 9-view display, nine viewswould be provided in the set.

The views are distinguished in some fashion. For example, referring toFIG. 3(B), a directional viewing system including a set of imagedispersion components 16 a, 16 b, 16 c, and so on, are provided todirect images from respective image display components 14 a, 14 b, 14 c,and so on, into various directions. For example, the first image fromeach set may be directed at one angle, the second image from the set ata different angle, and so on.

Systems and methods according to principles disclosed here are notlimited solely to lenticular lenses. Referring to FIG. 3(C), systems maybe devised in which inner surfaces of open grooves on the displaysurface are preferentially viewed from different viewpoints or angles.In FIG. 3(C), such systems are illustrated by respective imagedispersion components 18 a, 18 b, 18 c, and so on. Other imagedispersion systems may also be used, including those employing parallaxbarriers. No matter how the images are dispersed, such displays arereferred to herein as multiple view displays.

FIG. 4 illustrates in more detail how a particular column 12 i, i.e., aset of images, may exhibit multiple images 22 a, 22 b, 22 c, and 22 d.In FIG. 4, four views are illustrated, but it will be understood to oneof ordinary skill in the art that this number may vary. In some cases,just two views may be created, while in more complicated situationssixteen or more views may be created.

FIG. 5 illustrates a flowchart 30 of a method according to principlesdisclosed here. A first step is receiving image information about ascene (step 24). The image information may include depth information aswell as information about camera location. A next step is a generationof a plurality of alternate images corresponding to different views ofthe scene (step 26). This generation generally takes advantage of there-projection technique noted above. The image and plurality ofalternate images may be such that the user viewing the image and one ofthe alternate images, or two of the alternate images, is presented witha stereo pair, and thus views the scene in 3-D. Such occurs because theseparation of the viewer's eyes may be great enough that the left eyeviews one image and the right eye views another. It is noted that thisdiffers from standard stereo photography. For example, in standardstereo photography, no matter from which position one views the scene,one sees the same scene. In the multiple view system according toprinciples disclosed here, such is not the case. Rather, one's positionor location with respect to the display is highly influential in thescene one views, i.e., one may see a very different 3-D image fromlocation to location, although generally one will see an image in 3-Dfrom any arbitrary viewable position.

The images in the plurality may be of any number, but generally two tosixteen images may be generated (step 28). In many cases, the pluralityof images and thus plurality of angles are caused to be equiangular(step 32). In other words, if the display if such that discrete imagechanges occur as one's view is panned across the display, then theviewing changes may be configured to occur at equal increments in theviewing angle.

A final step of the flowchart 30 is to store the image and the pluralityof alternate images (step 34). This step is optional, or may be highlytransitory. For example, after creation of the plurality of alternateimages, the same may be displayed on a multiple view display and notsaved.

For example, referring to FIG. 6, a data file 60 may be composed of anumber of sets of images, e.g., a first set 58, a second set 62, and soon. Each set incorporates multiple views, i.e., alternate images, thoughof course one of the views may be the original image. The different setsmay be developed at least partially by a step of re-projection. The datafile 60 may be sent to a display input module 54 on a display 50. Thedisplay input module 54 may perform any needed functionality prior todisplay of the sets and various views using a display module 56 anddispersion of views of the multiple images through the dispersioncomponents 12 a-12 p, e.g., lenticular lenses (it will be understood inan actual system that many more columns of dispersion components willgenerally be employed).

FIG. 7 illustrates a modular computing environment 40 for a system formultiple view displays. The computing environment 40 includes aprocessor 36 which may process instructions provided to it from theother modules. An input module 38 may be employed to buffer and performpreprocessing on data received, e.g., from a source of an animation orother video file 44, a game engine 42, or the like. A re-projectionmodule 52 causes alternate images to be created from the received datain a manner as noted above. The resulting alternate images, as well asthe original image, may be caused to be stored by a storage module 46.

FIG. 8 illustrates an all-in-one system 70 for creation of sets ofalternate images for multiple view displays. The system 70 includes are-projection system 64 which performs the re-projection algorithmdescribed above. The re-projection system 64 may take as an input avideo image file 66 or, e.g., a direct video feed from a camera 68, solong as the video image file or camera data is able to provide depthinformation to allow the re-projection algorithm to operate. The resultof the re-projection algorithm may be sent to a data file 72, andsubsequently sent to a display 74. Alternatively, the result may be sentdirectly to the display. It will be understood that in some cases thedisplay 74 may also be integrated into the system 70, and inparticularly compact systems the camera 68 may as well.

FIG. 9 illustrates an alternative implementation of a multiple viewdisplay 75. While generally multiple view displays are formed of columnsin recognition of the usual horizontal orientation of a viewer's eyes,in some implementations images may also be caused to vary from top tobottom, i.e., may change as the viewing angle changes in a vertical pan.While generally less useful in current systems, the same may be employedin specialized implementations to achieve a desired purpose.

What has been described are systems and methods for creating images formultiple view displays, particularly to allow stereo images to bepresented to a viewer for three-dimensional viewing. The images may becreated using a step of fast re-projection, enabling not only rapidconversion of 2D footage to stereo but even on-the-fly creation ofmultiple view content, e.g., for live events, video games, or the like.

One implementation includes one or more programmable processors andcorresponding computer system components to store and execute computerinstructions, such as to provide the tools for creating multiple viewdisplays. Such a computing environment is disclosed below.

Referring to FIG. 10, a representation of an exemplary computingenvironment 80 for an animation workstation is illustrated.

The computing environment 80 includes a controller 76, a memory 82,storage 86, a media device 92, a user interface 98, an input/output(I/O) interface 102, and a network interface 104. The components areinterconnected by a common bus 106. Alternatively, different connectionconfigurations can be used, such as a star pattern with the controllerat the center.

The controller 76 includes a programmable processor and controls theoperation of an content creation system 78. The controller 76 loadsinstructions from the memory 82 or an embedded controller memory (notshown) and executes these instructions to control the system.

Memory 82, which may include non-transitory computer-readable memory 84,stores data temporarily for use by the other components of the system.In one implementation, the memory 82 is implemented as DRAM. In otherimplementations, the memory 82 also includes long-term or permanentmemory, such as flash memory and/or ROM.

Storage 86, which may include non-transitory computer-readable memory88, stores data temporarily or long-term for use by other components ofthe system, such as for storing data or instructions. In oneimplementation, the storage 86 is a hard disc drive or a solid statedrive.

The media device 92, which may include non-transitory computer-readablememory 94, receives removable media and reads and/or writes data to theinserted media. In one implementation, the media device 92 is an opticaldisc drive or disc burner, e.g., a writable Blu-ray® disc drive 96.

The user interface 98 includes components for accepting user input,e.g., the user indication of video files, viewing angles, or otheraspects discussed above, and presenting a display, e.g., of stereooutput images where the stereo aspect arises from a viewer's eyesviewing different angles of the scene. In one implementation, the userinterface 98 includes a keyboard, a mouse, audio speakers, and adisplay. The user interface may further include a lenticular or othermultiple view display. The controller 76 uses input from the user toadjust the operation of the computing environment.

The I/O interface 102 includes one or more I/O ports to connect tocorresponding I/O devices, such as external storage or supplementaldevices, e.g., cloud storage devices, a printer or a PDA. In oneimplementation, the ports of the I/O interface 102 include ports suchas: USB ports, PCMCIA ports, serial ports, and/or parallel ports. Inanother implementation, the I/O interface 102 includes a wirelessinterface for wireless communication with external devices. These I/Ointerfaces may be employed to connect to one or more content playbackdevices.

The network interface 104 allows connections with the local network andincludes a wired and/or wireless network connection, such as an RJ-45 orEthernet connection or “Wi-Fi” interface (802.11). Numerous other typesof network connections will be understood to be possible, includingWiMax, 3G or 4G, 802.15 protocols, 802.16 protocols, satellite,Bluetooth®, or the like.

The system may include additional hardware and software typical of suchdevices, e.g., power and operating systems, though these components arenot specifically shown in the figure for simplicity. In otherimplementations, different configurations of the devices can be used,e.g., different bus or storage configurations or a multi-processorconfiguration.

Various illustrative implementations of the present invention have beendescribed. However, one of ordinary skill in the art will recognize thatadditional implementations are also possible and are within the scope ofthe present invention. For example, the disclosed systems and methodscan be applied to images from movies, television, video games, etc.

Systems and methods according to present principles may be applied tonumerous types of displays, including those besides lenticular orparallax barriers. In addition, it is noted that, given progress indevelopment of computational 3D displays, 3D displays will improve withtime and will not just be limited to special screens like lenticularscreens or parallax barriers. Display technologies will change overtime, and this includes the type of display, the kinds of computation,the data formats that the same will use, etc. Accordingly, the scope ofthe invention goes well beyond lenticular displays and indeed caninclude any display technology which introduces reprojection between themedia input and the display. Thus, the invention may be employed as acomputational tool in any display as the same evolve.

Moreover, besides significant savings in bandwidth, display quality maybe increased because, rather than using a stream of, e.g., eight videoviewpoints, one could compute, e.g., 20 to 30 or even more viewpoints,making the change in viewpoints seamless, if as noted above the displaytechnology matures to computationally allow the same.

Accordingly, the present invention is not limited to only thoseimplementations described above.

1. A system for creating a multiple-view display, comprising: an inputmodule for receiving a computer-generated image of a scene, thecomputer-generated image including at least depth information about thescene; a re-projection module for creating a plurality of alternateimages corresponding to different views of the scene, wherein the imageand alternate images are such that a viewer observing the image and oneof the plurality, or two of the plurality, perceives a view of the sceneas a three-dimensional scene; and a storage module for storing the imageand the plurality of images.
 2. The system of claim 1, wherein the imageis from a video file.
 3. The system of claim 1, wherein the image isreceived from a game engine.
 4. The system of claim 1, wherein there-projection module selects a location for the alternate image, createsa disparity map indicating differences between the image and thealternate image, creates a distortion map indicating pixel transformsbased on the disparity map, and creates the alternate image by applyingthe distortion map to the pixels of the image.
 5. The system of claim 4,wherein the re-projection module further: applies a custom adaptivesharpening filter to one or more objects in the alternate image, thecustom adaptive sharpening filter configured to increase a prevalence ofhigh-frequency components and decrease a prevalence of low-frequencycomponents; or for one or more objects in the image, the one or moreobjects surrounded by a background or clipping plane, temporarilyextends the object's size by 1-10 pixels whereby when re-projectionoccurs, pixels in the object are mapped properly during re-projectionand not extended back to the background or clipping plane.
 6. A methodfor creating a multiple-view display, comprising: receiving acomputer-generated image of a scene, the computer-generated image havinginformation including at least depth information; using a step ofre-projection, generating a plurality of alternate images, the alternateimages corresponding to different views of the scene, wherein the imageand alternate images are such that a viewer observing the image and oneof the plurality, or two of the plurality, perceives a view of the sceneas a three-dimensional scene; and storing the image and the alternateimages corresponding to the different views of the scene.
 7. The methodof claim 6, wherein the plurality numbers from two to sixteen.
 8. Themethod of claim 7, wherein the plurality includes eight images, four onone side of the image and four on an opposite side of the image.
 9. Themethod of claim 8, wherein each set of four are equi-angularly spacedfrom the image.
 10. The method of claim 6, wherein the step ofre-projection includes calculating a view of the scene from a differentangle.
 11. The method of claim 10, wherein the step of re-projectionincludes: selecting a location for the alternate image; creating adisparity map indicating differences between the image and the alternateimage; creating a distortion map indicating pixel transforms based onthe disparity map; and creating the alternate image by applying thedistortion map to the pixels of the image.
 12. The method of claim 11,wherein the step of re-projection further includes performing one orboth of the following steps: applying a custom adaptive sharpeningfilter to one or more objects in the alternate image, the customadaptive sharpening filter configured to increase a prevalence ofhigh-frequency components and decrease a prevalence of low-frequencycomponents; or for one or more objects in the image, the one or moreobjects surrounded by a background or clipping plane, temporarilyextending the object's size by 1-10 pixels whereby when re-projectionoccurs, pixels in the object are mapped properly during re-projectionand not extended back to the background or clipping plane.
 13. Amultiple-view display, comprising: an input module for receiving a datafile, the data file including multiple sets of images corresponding tovarious views of a scene, each set corresponding to a geographic area ona display screen, each member of each set corresponding to a differentview of the scene as displayed at the geographic area, at least onemember of each set developed by a step of re-projection of an originalimage, the original image including at least depth information about thescene; a display module to display each set at its correspondinggeographic area, and to display each member of the set within the area;a directional viewing system disposed adjacent the display module, thedirectional viewing system configured to direct a view of each membersubstantially at a given angle relative to the plane of the geographicarea.
 14. The display of claim 13, wherein the directional viewingsystem is a lenticular display or a parallax barrier.
 15. The display ofclaim 13, wherein the given angle is different for each member of a set.16. The display of claim 13, wherein corresponding members of setsdirect views at a common angle relative to the plane of the geographicarea.
 17. The display of claim 13, wherein the directional viewingsystem is configured to direct views at between two and sixteendifferent angles.
 18. The display of claim 13, wherein the geographicarea is a line of display.
 19. The display of claim 13, wherein thegeographic area is in the shape of a rectangle.
 20. The display of claim13, wherein each member of the set is created by re-projection byselecting a location for the member of the set, creating a disparity mapindicating differences between the original image and an imagecorresponding to the member of the set at the location, creating adistortion map indicating pixel transforms based on the disparity map,and creating the image corresponding to the member of the set at thelocation by applying the distortion map to the pixels of the originalimage.
 21. The display of claim 20, wherein the image corresponding tothe member of the set is further created by: applying a custom adaptivesharpening filter to one or more objects in the image corresponding tothe member of the set, the custom adaptive sharpening filter configuredto increase a prevalence of high-frequency components and decrease aprevalence of low-frequency components; or for one or more objects inthe original image, the one or more objects surrounded by a backgroundor clipping plane, temporarily extending the object's size by 1-10pixels whereby when re-projection occurs, pixels in the object aremapped properly during re-projection and not extended back to thebackground or clipping plane.
 22. A data file, the data file includingmultiple sets of images corresponding to various views of a scene, eachset corresponding to a geographic area on a display screen, each memberof each set corresponding to a different view of the scene as displayedat the geographic area, at least one member of each set developed by astep of re-projection of an original image, the original image includingat least depth information about the scene.
 23. The data file of claim22, wherein the geographic area is a vertical line of display.
 24. Thedata file of claim 22, wherein the geographic area is in the shape of arectangle.
 25. The data file of claim 22, wherein each member of the setis created by re-projection by selecting a location for the member ofthe set, creating a disparity map indicating differences between theoriginal image and an image corresponding to the member of the set atthe location, creating a distortion map indicating pixel transformsbased on the disparity map, and creating the image corresponding to themember of the set at the location by applying the distortion map to thepixels of the original image.
 26. The data file of claim 25, wherein theimage corresponding to the member of the set is further created by:applying a custom adaptive sharpening filter to one or more objects inthe image corresponding to the member of the set, the custom adaptivesharpening filter configured to increase a prevalence of high-frequencycomponents and decrease a prevalence of low-frequency components; or forone or more objects in the original image, the one or more objectssurrounded by a background or clipping plane, temporarily extending theobject's size by 1-10 pixels whereby when re-projection occurs, pixelsin the object are mapped properly during re-projection and not extendedback to the background or clipping plane.